ORIGINAL ARTICLE 



Korean J Intern Med 2013;28:322-329 
http://dx.doi.Org/10.390Vkjim.2013.28.3.322 



kjiivT 



A comparison of the BISAP score and serum 
procalcitonin for predicting the severity of acute 
pancreatitis 

Byung Geun Kim 1 , Myung Hwan Noh 1 , Choong Heon Ryu 1 , Hwa Seong Nam 1 , Su Mi Woo 1 , Seung Hee Ryu 1 , 
Jin Seok Jang 1 , Jong Hun Lee 1 , Seok Ryeol Choi 1 , and Byeong Ho Park 2 



'Division of Gastroenterology, 
Department of Internal Medicine, 
and department of Radiology, 
Dong-A University College of 
Medicine, Busan, Korea 



Received: May 3, 2012 
Revised : June 19, 2012 
Accepted: July 19, 2012 

Correspondence to 
Myung Hwan Noh, M.D. 

Division of Gastroenterology, 
Department of Internal 
Medicine, Dong-A University 
College of Medicine, 26 
Daesingongwon-ro, Seo-gu, 
Busan 602-715, Korea 
Tel: +82-51-240-2862 
Fax: +82-51-242-5852 
E-mail: mhnho@dau.ac.kr 



Background/Aims: The bedside index of severity in acute pancreatitis (BISAP) 
is a new, convenient, prognostic multifactorial scoring system. As more data are 
needed before clinical application, we compared BISAP, the serum procalcitonin 
(PCT), and other multifactorial scoring systems simultaneously. 
Methods: Fifty consecutive acute pancreatitis patients were enrolled prospec- 
tively. Blood samples were obtained at admission and after 48 hours and imaging 
studies were performed within 48 hours of admission. The BISAP score was com- 
pared with the serum PCT, Ranson's score, and the acute physiology and chronic 
health examination (APACHE)-II, Glasgow, and Balthazar computed tomography 
severity index (BCTSI) scores. Acute pancreatitis was graded using the Atlanta cri- 
teria. The predictive accuracy of the scoring systems was measured using the area 
under the receiver- operating curve (AUC). 

Results: The accuracy of BISAP (> 2) at predicting severe acute pancreatitis was 
84% and was superior to the serum PCT (> 3.29 ng/mL, 76%) which was similar to 
the APACHE-II score. The best cutoff value of BISAP was 2 (AUC, 0.873; 95% con- 
fidence interval, 0.770 to 0.976; p < 0.001). In logistic regression analysis, BISAP 
had greater statistical significance than serum PCT. 

Conclusions: BISAP is more accurate for predicting the severity of acute pancre- 
atitis than the serum PCT, APACHE-II, Glasgow, and BCTSI scores. 
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INTRODUCTION 

Acute pancreatitis (AP) is highly variable in terms of its 
clinical presentation and severity [1,2]. Many scoring 
systems have been developed for the early detection of 
severe AP, but they are not convenient for predicting 
the severity of AP since they involve many parameters 

[3-5]. 

Ranson's score is relatively accurate at classifying 
the severity of AP, but it is difficult to calculate the 
score as it requires a 48 -hour, missing the potential for 



early treatment [6]. The acute physiology and chronic 
health examination (APACHE)-II is more accurate 
than Ranson's score [7], and is more commonly used 
to predict the severity of AP [7-9], although it was de- 
signed originally to predict intensive care unit sur- 
vival and required the collection of many parameters, 
some of which might not be relevant to AP prognosis 
[10]. The Glasgow score also requires many clinical 
parameters and needs 48 hours to complete. In 1990, 
Balthazar et al. [11] described the utility of contrast- 
enhanced computed tomography (CT) for evaluating 
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the severity of AP and developed the Balthazar com- 
puted tomography severity index (BCTSI) based on 
contrast- enhanced CT, but this system was based on 
local complications and did not reflect the systemic 
inflammatory response. The biochemical marker se- 
rum procalcitonin (PCT) is a relatively accurate and 
convenient method for predicting the severity in AP 
and is easily measured [12,13]. Some studies revealed a 
strong relationship between an increased serum PCT 
and the severity of AP [12,14,15]. 

In our previous study, the serum PCT level in se- 
vere AP was significantly higher than in mild AP. 
The accuracy of serum PCT as biochemical marker 
was 77.3%, which was similar to the APACHE-II score, 
worse than Ranson's score (93.2%), and better than the 
BCTSI (65.9%) [16]. In 2008, Wu et al. [17] proposed new 
prognostic scoring system for the early determination 
of the severity of AP, which they named the bedside 
index of severity in acute pancreatitis (BISAP). BISAP 
incorporates five parameters: blood urea nitrogen 
> 25 mg/dL, impaired mental status, systemic inflam- 
matory response syndrome (SIRS), age > 60 years, and 
detection of pleural effusion by imaging [17,18]. SIRS 
is defined by the presence of at least two of the follow- 
ing: pulse > 90 beats per minute, respirations > 20 per 
minute, PaC0 2 < 32 mmHg, temperature > 38°C or < 
37°C, and white blood cell count > 12,000 or < 4,000 
cells/mm 3 , or > 10% immature neutrophils (bands) 
[19,20]. A prospective validation of the BISAP scoring 
system as a method for the early detection of severe AP 
was published recently, and concluded that it is a reli- 
able, accurate means for stratifying patients with AP 
[17] and that it was an accurate and convenient method 
of risk stratification compared with other multifacto- 
rial scoring systems in patients with AP [21]. However, 
the BISAP data are limited and insufficient for clinical 
application. The serum PCT is a simple, convenient 
method for predicting the severity of AP [12,14,15], 
with similar accuracy to the APACHE-II score [16]. As 
no study has compared BISAP with the serum PCT, 
we compared the accuracies of the BISAP, serum PCT, 
and other scoring systems in terms of predicting the 
severity of AP. 



METHODS 
Study population 

This prospective study enrolled 50 consecutive pa- 
tients with AP admitted to Dong-A University Hos- 
pital, Busan, Korea over a 14-month period. The 
diagnosis of AP was based on acute upper abdominal 
pain associated with a serum amylase level greater 
than three times the normal value or an elevated se- 
rum lipase level and radiological evidence of AP. The 
patients were treated using the accepted standard 
management of AP [22]. All patients were fasted soon 
after admission and given fluids, electrolytes, and an- 
algesics parenterally. If necessary, systemic antibiotics 
were administered. Patients with a suspected biliary 
cause of AP underwent endoscopic retrograde cholan- 
giopancreaticography within the first 24 hours. 

Methods 

Blood samples for PCT were collected on admission 
and biochemical tests for the other scoring systems 
were performed on admission (day o) and within 48 
hours (day 2). Appropriate physiological data were 
recorded and weighted for age and chronic health to 
permit calculation of the Ranson's, APACHE-II, and 
Glasgow scores. The BISAP and APACHE-II scores 
were calculated from data obtained within 24 hours 
of admission, while Ranson's score was calculated at 
and 48 hours after admission. Contrast- enhanced CT 
was performed within 48 hours of admission and re- 
peated weekly if the symptoms worsened. For serum 
PCT, blood samples were centrifuged for 10 minutes at 
3,000 rotations per minute at -4°C. The serum was re- 
moved and stored at -8o°C until biochemical analysis. 
The serum PCT concentration was measured using 
a chemiluminescent immunoassay (LUMItest PCT, 
Brahms Diagnostica, Berlin, Germany). The reference 
value range established for this method was < 0.05 ng/ 
mL. All patients were classified as mild or severe AP 
according to the Atlanta criteria [23]. This study was 
approved by the Institutional Review Board of Dong-A 
University Hospital, Busan, South Korea. 

Statistical analysis 

We expressed the results as medians followed by range 
or 95% confidence interval. Groups were compared us- 
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ing the Mann-Whitney U test for noncategorical data; 
Fisher's exact test was used to examine differences 
in the sex ratio, etiology, and death ratio. The cutoff 
values of BISAP, serum PCT, and other parameters 
were determined using receiver operating character- 
istic (ROC) curves. Sensitivity, specificity, positive, and 
negative predictive values, accuracy, and likelihood 
ratios were also calculated. Logistic regression analy- 
sis was used to establish the influence of the chosen 
parameters on the prognosis of AP. Linear regression 
analysis was conducted to estimate the relationship 
between the BISAP scores and length of hospital stay. 
The relationship between the serum PCT and length 
of hospitalization was evaluated using the same sta- 
tistical method. A p value < 0.05 was considered to in- 
dicate statistical significance. The PASW version 18.0 
for Windows (IBM Co., Armonk, NY, USA) was used to 
perform all statistical analyses. 



RESULTS 

Fifty patients were enrolled in the study: 34 males and 
16 females. The median patient age was 59.5 years. Ac- 
cording to the Atlanta criteria, 26 patients were clas- 
sified as mild AP and 24 as severe AP. There were no 
significant differences according to age (p = 0.228) and 
sex (p = 0.85). The causes of AP were alcoholic, biliary 
stone, and idiopathic or miscellaneous; differences 
were not significant (p = 0.465) (Table 1). Seven patients 
died: four of multiple organ failure and two of severe 
necrotizing pancreatitis; all six had severe AP, while 
one patient with mild AP and underlying thyroid 
cancer had a sudden cardiac arrest with no previous 
cardiac problems. The parameters according to the 
Atlanta criteria are described in Table 1. All six param- 
eters were analyzed using the area under the receiver- 
operating curve (AUC) to predicting severe AP and the 
BISAP results were excellent (AUC = 0.873; P = 0.001) 
and the serum PCT was good (AUC = 0.788; p = 0.001) 



Table 1. Characteristics of the patients with acute pancreatitis 



Characteristic 


Mild pancreatitis (n = 26) 


Severe pancreatitis (n = 24) 


Total (n = 50) 


p value 


Male/Female 


18/8 


16/8 


34/16 


0.850 


Age, yr 


54.5 (22-89) 


64.5 (39-79) 


59.5 (22-89) 


0.228 


Deaths 


1 


6 


7 


0.032 


Duration of admission, day 


11.5 (6-35) 


18.5 (2-40) 


15.5 (2-40) 


0.152 


Etiology 








0.465 


Alcoholic 


10 


13 


23 




Biliary stone 


8 


4 


12 




Idiopathic and miscellaneous 


8 


7 


15 




Scoring system and biochemical markers 


BISAP score 


1(0-3) 


3(o-5) 


1(0-5) 


< 0.001 


PCT, ng/mL 


0.39 (0.01-18.82) 


4.15 (0.01-166.69) 


1.66 (0.01-166.69) 


0.018 


Ranson's score 


2(0-5) 


4(2-9) 


2(0-9) 


< 0.001 


APACHE-II score 


4(0-8) 


10.5 (2-19) 


6(0-19) 


< 0.001 


Glasgow score 


1(0-4) 


3-5 (i-7) 


2(0-7) 


< 0.001 


BCTSI 


3(i-5) 


4(2-5) 


3(i-5) 


0.023 



Values are presented as median (range). 

BISAP, bedside index of severity in acute pancreatitis; PCT, procalcitonin; APACHE-II, acute physiology and chronic health 
examination-II; BCTSI, Balthazar computed tomography severity index. 
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(Fig. 1). According to the analysis, Ranson's scores were 
the most accurate (AUC = 0.947) and the BISAP and 
APACHE-II scores had similar accuracy for predicting 
severe AP (AUC = 0.873 an d AUC = 0.857, respectively). 
The serum PCT had relatively low accuracy (AUC = 
0.788), but was better than the BCTSI score (AUC = 
0.676). All six parameters were significant in terms of 
predicting the severity of AP (p < 0.05) (Table 2). To as- 
sess significance, BISAP scores were analyzed using 
two cutoff values and serum PCT levels were analyzed 
using four cutoff values. For the BISAP, scores of 2 were 
more accurate than scores of 3. For the serum PCT, 1.77 
and 3.29 ng/mL had the same accuracy, but the sen- 
sitivity, positive predictive value, and likelihood ratio 
were higher for 3.29 ng/mL, making it the best cutoff 
(Table 3). The sensitivity, specificity, positive and nega- 




0.0 0.2 04 0.6 0.8 1.0 



i-Specificity 

Figure 1. Receiver operation characteristic curve of serum 
levels of bedside index for severity in acute pancreatitis 
(BISAP) and procalcitonin in prediction of severity of acute 
pancreatitis. BISAP had excellent value (AUC = 0.873; P = 
0.001) and serum procalcitonin had good value (AUC = 0.788; 
p = 0.001). AUC, area under the receiver-operating curve. 



tive predictive values, accuracy, and likelihood ratio for 
the other parameters with the best cutoff value were 
also analyzed (Table 4). Logistic regression analysis of 
risk factors for severe AP revealed that the odds ratios 
of the BISAP and serum PCT were 29.13 (> 2, p< 0.001) 
and 11.00 (> 3.29 ng/mL, p < 0.001), respectively (Table 
5). In a simple linear regression analysis of admission 
duration, the BISAP had no significant relationship 
with hospital stay (p = 0.073), while the serum PCT was 
correlated with the length of hospital stay (p = 0.014), 
although it had a low f value (r 2 = 0.118) (Fig. 2). 

DISCUSSION 

AP is a common disorder that places a substantial bur- 
den on the healthcare system [24]. The clinical course 
of AP is usually mild and it often resolves without se- 
quelae. Nonetheless, 10% to 20% of patients experience 
a severe AP attack, resulting in an intense inflamma- 
tory response, a variety of local and systemic compli- 
cations, a prolonged hospital course, and significant 
morbidity and mortality [25]. The scoring of patients 
with AP is important for several reasons. First, the 
clinician can be alerted to the presence of potentially 
severe disease. Second, severity can be compared both 
within and between patient series. Third, a rational 
selection of patients can be made for inclusion in tri- 
als of potential new treatments or interventions. Un- 
fortunately, the scoring systems used at present are 
often inadequate in patients with severe AP, which is 
characterized by rapidly progressive multiple system 
organ dysfunction [26-28]. Therefore, a simple scoring 
system or single biomarker that predicts the sever- 
ity of AP is needed. Serum C -reactive protein (CRP) 



Table 2. Area under the receiver- operating curve of scoring systems for predicting the severity of acute pancreatitis 





BISAP 


PCT 


Ranson's 


APACHE-II 


Glasgow 


BCTSI 


AUC 


0.873 


0.788 


0.947 


0.857 


0.882 


0.676 


95% CI 


0.770-0.976 


0.660-0.917 


0.001-1.000 


0.753-0.961 


0.792-0.973 


0.527-0.825 


p value 


< 0.001 


< 0.001 


< 0.001 


< 0.001 


< 0.001 


0.033 



BISAP, bedside index of severity in acute pancreatitis; PCT, procalcitonin; APACHE-II, acute physiology and chronic health 
examination-II; BCTSI, Balthazar computed tomography severity index; AUC, area under the receiver-operating curve; CI, 
confidence interval. 
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Table 3. Analysis of BISAP scores and serum procalcitonin 



Cutoff value 


Sensitivity 


Specificity 


PPV 


NPV 


Accuracy 


Likelihood ratio 


BISAP 


2 


79.17 


88.46 


86.36 


82.14 


84 


25 433 


3 


58.33 


96.15 


93-33 


71.43 


78 


20.008 


PCT, ng/mL 














0.50 


87.5 


23.08 


51.22 


66.67 


54 


11.831 


1.00 


83.33 


65.38 


68.97 


80.95 


74 


12.861 


1.77 


75 


76.92 


75 


76.92 


76 


14.152 


3.29 


66.67 


84.62 


80 


73-33 


76 


14.424 



Values are presented as percentage. 

BISAP, bedside index of severity in acute pancreatitis; PPV, positive predictive value; NPV, negative predictive value; PCT, 
procalcitonin. 



Table 4. Analysis of various parameters 



Parameter 


Sensitivity 


Specificity 


PPV 


NPV 


Accuracy 


Likelihood ratio 


BISAP > 2 


79.17 


88.46 


86.36 


82.14 


84 


25.433 


PCT > 3.29 ng/mL 


66.67 


84.62 


80 


73-33 


76 


14.424 


Ranson's score > 3 


91.67 


96.15 


95.65 


92.59 


94 


46.749 


APACHE-II > 7 


75 


76.92 


75 


76.92 


76 


14.152 


Glasgow score > 3 


66.67 


92.31 


88.89 


75 


80 


18.462 


BCTSI > 4 


62.5 


65.38 


62.5 


65.38 


64 


3.938 



Values are presented as percentage. 

PPV, positive predictive value; NPV, negative predictive value; BISAP, bedside index of severity in acute pancreatitis; PCT, 
procalcitonin; APACHE-II, acute physiology and chronic health examination-II; BCTSI, Balthazar computed tomography 
severity index. 



Table 5. Logistic regression analysis of risk factors for severe acute pancreatitis 





B 


Odds ratio 


p value 




95% CI 


Upper 


Lower 


BISAP > 2 


3372 


29.13 


< 0.001 


6.153 


137.947 


PCT > 3.29 ng/mL 


2.398 


11.00 


0.001 


2.817 


42.947 


Ranson score > 3 


5.617 


275.00 


< 0.001 


23.310 


3,244.305 


APACHE-II > 7 


2.303 


10.00 


0.001 


2.730 


36.636 


Glasgow score > 3 


3.178 


24.00 


< 0.001 


4.502 


127.957 


BCTSI > 4 


1.147 


3.15 


0.052 


0.991 


10.000 



CI, confidence interval; BISAP, bedside index of severity in acute pancreatitis; PCT, procalcitonin; APACHE-II, acute physiology 
and chronic health examination-II; BCTSI, Balthazar computed tomography severity index. 
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Figure 2. Correlation between serum procalcitonin (PCT) 
levels and duration of admission in patients with acute 
pancreatitis by simple linear regression and expressed as a 
graph. Serum PCT were correlated with length of hospital 
stay (p = 0.014) but with ratively low R square (0.118). 

was reported (CRP > 15 mg/dL on admission) to pre- 
dict severe AP with an overall accuracy of 69% [29]. 
Consequently, many studies have described its clini- 
cal limitation; i.e., a potential failure to detect severe 
cases of AP in the early stage [30-33]. Serum PCT was 
introduced as prognostic marker of AP, focusing on 
systemic inflammation and organ failure in the early 
stage of AP [34]. In 2008, Gurda-Duda et al. [12] stated 
that the early prediction of severe AP was achievable 
by measuring PCT, and many subsequent studies 
reported the efficacy of PCT as a predictor of AP, al- 
though there is some debate [14,15,30,35]. Our study 
revealed that the serum PCT was a significant predic- 
tor of severe AP (p = 0.018) and was consistent with our 
previous report [16]. In 2008, Wu et al. [17] introduced 
the BISAP and their results were relatively satisfactory 
[18,21], although more data were needed to determine 
its clinical applicability. In this study, we compared 
the BISAP with the serum PCT as a predictor of AP, 
and included other multifactorial scoring systems that 
predict the severity of AP as control parameters. In 
our series, Ranson's scores had the greatest accuracy 
for predicting the severity of AP (94%), followed by the 
BISAP (84%); the AUC of the BISAP was 0.873, which 
was superior to the results in Wu et al. [17] (AUC = 0.82) 
and Papachristou et al. [21] (AUC = 0.81). We found that 
the best cutoff score of BISAP was 2, while most other 
studies have proposed 3 to be the best cutoff score 
[17,18,21]. In our analysis, a BISAP score of 2 had great- 



er accuracy, with a better likelihood ratio than a score 
of 3 (84% vs. 78% and 25.433 vs. 20.008, respectively). 
With a BISAP score of 2 in severe AP had 80% of SIRS, 
which was not observed with the same score of 2 in 
mild AP, which suggests that SIRS is an independent 
risk factor in the BISAP scoring system. In our study, 
the accuracy of serum PCT was 76% and the AUC was 
0.788, which is similar to other reports [14,15,30,34-36]. 
In the analysis of four cutoff values of the serum PCT, 
1.77 and 3.29 ng/mL had the same accuracy (76%), but 
3.29 ng/mL had a slightly higher likelihood ratio (14.152 
vs. 14.424), making 3.29 ng/mL the best cutoff level. 
Comparing BISAP with the serum PCT, the former 
had better sensitivity, specificity, accuracy, likelihood 
ratio, odds ratio (29.13 vs. 11.00) and p value (< 0.001 vs. 
0.001) in the logistic regression analysis. Regarding 
the duration of hospitalization, the BISAP was not sig- 
nificantly related (p = 0.073), while the serum PCT had 
a significant p value (0.014), although r 2 was low (0.118). 
Nevertheless, the BISAP was superior to serum PCT 
in terms of predicting the severity of AP. We did not 
measure serial PCT levels because this study investi- 
gated the potential role of the PCT level in the early 
prediction (on the day of admission) of disease severity 
in patients with AP and compared it with the BISAP 
within 24 hours. However, Kylanpaa-Back et al. [14] 
demonstrated the influence of a delayed peak in PCT 
on predicting the severity of attacks, reporting greater 
sensitivity (92%) with the PCT strip test 24 hours after 
admission to hospital. Our study enrolled 50 consecu- 
tive patients with AP over a 14-month period: using 
the Atlanta classification, 52% (26/50) had mild pan- 
creatitis and the other 48% (24/50) had severe AP. Most 
recent studies included only a few cases, which were 
usually classified as severe necrotizing pancreatitis. In 
contrast, our series contained only a few patients with 
severe necrotizing pancreatitis and the diagnosis of 
necrotizing pancreatitis was made using imaging tools 
and laboratory findings, not histologically. Therefore, 
we think that larger populations are needed to obtain 
more precise results. 

In conclusion, the serum PCT is useful for predict- 
ing the severity of AP and has an accuracy similar to 
that of the APACHE-II score. The BISAP is relatively 
simple and had greater accuracy than other multifac- 
torial scoring systems, except Ranson's score, making 
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it a promising method of predicting the clinical sever- 
ity of AP. 

KEY MESSAGE 

1. Bedside index of severity in acute pancreati- 
tis (BISAP) scoring is simple and convenient 
method for predicting the severity of acute 
pancreatitis. 

2. The accuracy of BISAP (> 2) at predicting 
severe acute pancreatitis was superior to the 
serum procalcitonin (> 3.29 ng/mL, 76%) 
which was similar to the acute physiology 
and chronic health examination (APACHE)-II 
score. 
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